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ABSTRACT 

An attempt is made in this working paper to 
synthesize the existing empirical evidence concerning the utility of 
simulation games in social studies teaching, training, and research. 
The data arc drawn from several sources: published literature dealing 
with simulation games, descriptions of games in use, communications 
with people who use games, and personal experience with the design 
and use of games for education. The independent variables that seem 
likely to be related to the costs and benefits of simulation are 
delineated: 1) purpose; and, 2) structure including a discussion of 
goals, rules, team system, internal structure of the teams, and 
participants. These dependent variables are also discussed: 1) 
learning motivation; 2) the discovery, verification or inculcation of 
social facts and principles; and, 3) the development of skills or 
discovery of hypotheses regarding decision-making, manipulative 
skills, and interactive behavior. The disparity between the positive 
and negative evaluations of simulation in terms of these variables is 
explained as resulting from a lack of empirical or objective 
research, and the perception of the weaknesses of simulation games 
— lack of teacher control over learning, scheduling difficulty, and 
cost. (SBE) 
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With fifteen years of experience one might expect that ve would 
know quite a bit about the efficacy of circulation gcnr.es in social 
science research and education, but we don't. What we do have is an 
inventory of often contradictory propositions about their value. While 
often based upon first-hand observation, these propositions arc seldom 
if ever the result of scientific study. This is beginning to change. 

As Sarane S. Boocock has pointed out, the field of simulation gaming 
has passed through three phases since the 1950's: acceptance on faith 
through 1962 or 1963, a "post-honeymoon" period during the years 1963 
through 1965 when the first crude attempts to evaluate games led to 
inconclusive results and disenchantment, and the present period of 
"realistic optimism" based upon accumulated experience and further 
experimentation • 2 

This paper, an interim effort , attempts to synthesize the existing 
empirical evidence concerning the utility of simulation games in social 
studies teaching, training, and research. Our data are drawn from 
several sources: published literature dealing with simulation games, 
descriptions of simulation games in use, communications with fellow 
gamers, and our own experience with the design and use of simulation 
games for education. At the moment, the best we can do is to offer a 
preliminary codification of the present confusion through a delineation 
of the Independent variables that seem likely to be related to the costs 
and benefits of simulation games and of preliminary assessment and their 
advantages and disadvantages. Our flnAl study will attempt a more 
rigorous causal connection between the two sections of the present 
paper based on an extensive survey effort that is now under way. 



A Taxonomy of Simulation Games 

A delineation of potentially significant Independent variables 
must begin with "purpose" which Doth affects and defines the dependent 

variables developed under "Advantages" and "Disadvantages" below. The 
purpose of simulation games may be either to teach, to impart knowledge 
and understanding of a body of information or to inculcate a set of 
attitudes or a system of values relating to the social system; to train, 
to impart a set of skills relative to the manipulation of the social 
environment; or to contribute to research, to lead to the discovery or 



2. Sarane S. Boocock and E. 0. Schlld; "Introduction," in Simulation 
Games and Learning , ed. by Sarane S. Boocock and E. 0. Schlld; 
Sage Publications, Inc., Beverly Kills, California; I960, pp. 13- 
26. 
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confirmation of the possibility of probabilistic social contingencies, of 
the utility and/or operat locality of social concepts, or of the exist* 
once of general principles concerning the social universe. These 
objectives are by uo means mutually exclusive; yet not all games serve 
all objectives. Certainly most games do not serve them all well. For 
example, as a teaching tool, the value of a game to students may in* 
crease when its scope is enlarged, while the value of that game to those 
Interested in policy-oriented research is degraded ,3 

One may characterize simulation games by their structure. The 
rules of the game, or lack thereof, are crucial to that structure, 

James S. Coleman has categorized game rules as: 

1, goals developed by and/or imposed upon the participants 

2. environmental response rules , wherein the rules substitute 
for that portion of the social system not directly represented 
by the participant teams in the simulation 

3* procedural rules , describing how the game is to be put Into 
play and the general order in which play proceeds 

jt 

4, behavioral rules , corresponding to role specifications, 
describing what the participant can and cannot do 

5, police rules , outlining the consequences of breaking one of 
the game's rule*4 

The principal simulation games vary according to the abstractness, 
detail, scope, restrictiveness, source, and time of specification of 

each of the above, ; 

# « 

The rules of INS, the most widely used of the present international 
educational simulations, are quite abstract and detailed; but the detail 
still allows great flexibility by both the control group and the 



3, Goldhamer and Speler; p, 272, 

4, James S. Coleman; "Simulation Games and Social Theory"; Report 
Number 8 of the Center for the Study of Social Organization of 
Schools, Johns Hopkins University, Baltimore, Maryland; 1968, 

pp. 6-10 
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participating teams, POLIDOX (political paradox), the principal inter- 
national simulation gat r*e. now in use at tho Air IVrce Academy, is as 
abstract and only slightly less detailed in itc nncs. Flexibility 
remains high, POLIDOX contains a unique feature in the area of goal- 
retting, Within limits, the student teams create their own "national 
interest" at the beginning of play and then arc graded according to the 
congruence of "international" outcomes to that Interest, By contrast, 
the Joint War Games Agency (JWGA) games do not set up a complex, 
detailed rule framework. Rather, most of the guidance affecting the 
flow of the game is ad hoc, flowing almost solely from the good judgment 
and experience of the control group. The early RAND games and the POLEX 
games at MIT follow a similar pattern. 

The simulation game universe is comprised of more than rules. The 
living portion of the game structure can be categorized and compared at 
three levels: the team system, the internal structure of the teams, 

and the participants that make up the teams. Team systems can be 
characterized by their abstractness , the number of actors directly 
represented, inter- team internal homogeneity, the distribution of power 
and other attributes, and the communication systems provided to the 
teams. The system represented 1st INS is quite abstract, as is the one in 
POLIDOX, although both may be structured to approximate the power distri- 
bution and other attributes of -'an historical system* The POLEX, RAND, 
and JWGA systems are less abstract in the sense that the actors and 
their power relationships are as they are today, but the actors are 
frequently called upon to deal with a set of hypothetical events. 
Dangerous Parallel, a crisis game developed by the Foreign Policy 
Association, is at once more abstract and more concrete. It is a 
disguised simulation of the outbreak and conduct of the Korean War. 
Empire, an international trading game designed by Abt Associates, Inc. 
to Increase understanding of the trade relations in the British Empire 
circa 1735 is the most concrete of all. An historical system is 
explicitly created and rigidly controlled to conform to the situation 
then extent. 



The Internal structures of the teams vary as much as do the team 
systems from game to game. However, for purposes of research into the 
efficacy of simulation games, the formal structuring of teams may not be 
an important variable. It seems to have less impact on behavior than 
does the formal structuring of the system. Regardless of role and 
decision rule specifications, teams tend to fall into unique organiza- 
tions based on informal relationships developed prior to or during play 



5. Reported several places in the literature, and experienced at the 
Air Force Academy games. 
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Finally, the structure of simulation games differs according to 
the type of participant. Participant characteristics vary from game to 
INS, for example, has. been played with facility by homogeneous 
and heterogeneous mixes of participants ranging from grade school to 
post-graduate level, from layman to expert, and from aggressive to 
cautious personality types. On the other hand, a game like Empire Is 
definitely best suited and normally used to educate participants at the 
elementary and secondary school levels. 

Dynamic, interactive characteristics of games differ as much as 
those of structure and should, it would seem, be as important to learn- 
ing outcomes. Initial scenarios can be dichotomized into crisis and 
noncrisis situations. In INS and POLIDOX crises, if they occur at all, 
are developed out of the internal dynamics of the game, while crises 
are imposed at the outset in POLEX and most high-level policy games run 
by the JWGA. Once any game begins, interaction can be influenced by 
the role assigned to the control group, either active or passive. If 
assigned an active role, the control group can direct communication, 
inject nonteam generated inputs into the system, and r;herwise guide 
the flow of the game. Other. important influences on the nature of 
interaction are the ease and means of inter- and intra-team com smile atton ; 
the number, length, and spacing of play periods; the privacy of team 
areas; the permissible instruments and arenas of interaction; the tempo 
of game time; and several other factors, many of which have little to do 
with the particular game being played and much to do with the immediate 
circumstances surrounding a particular play. 

Much needs to be done to specify which of the variable character- 
istics of games and their settings may be significant for learning and 
research outcomes. These characteristics would be the independent | 
variables in the rigorous experimental work that needs to be accomplished. 
A preliminary survey of the literature does reveal a few, which will ije 
touched on later. Generally speaking, however, most claims to the 
advantages or disadvantages of simulation games do not bother to 

specify conditional factors such as particular simulation characteristics 
and situations of use. 



Advantages 

Supporters claim that games remove certain impediments to learning 
occur, especially, but not exclusively, at the secondary school 
level: 

Dr. Coleman has pointed out the learning advantages that result 
when penalties ace imposed by rules of the gs.7.0 or peers instead 
of by authority figures. Too often reb~- -'.on or hostility toward 
adult . . . society interferes with icar. .... In the 
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simulation environment . the teacher is without authority, often a 
mere bystander; so whatever lessons students learn come from the 
game itself. 6 

Not only must the ctudent be freed from a motivation not to learn, he 
rnuat also be motivated t£ learn. Simulation games have been highly 
praised for their facility in motivating the student to become more 
active in the game, and hence to learn whatever there is to be learned 
directly from participation; to go beyond the game during its play by 
reading substantive material in depth so as to learn how to survive in 
the game; and to continue to delve into the substantive material after 
the game is over because of the new interest evoked by the game through 
involvement and a new sense of efficacy. Examples of all these 
behaviors are to be found in the literature. Host sources agree that 
the first type of motivation leading to active participation is 
normally exhibited. 7 With regard to the second, one finds such 
favorable reports as "some students were more willing to read books x , 
like The Federalist Papers Tin the U. S. History simulation "Disunia'iJ , 
since the knowledge used from such reading could be used in the game. u 
Similarly, in another game setting, students have sought information 
beyond the curriculum to help them succeed. ® Evidence of the third 
type of motivation is contained in the following observation made about 
an International relations Simulation undertaken at University College 
London : 

The odd student that inevitably gets into a class and who is not 
greatly Interested soon becomes involved in simulation— and he 
turns up to other classes because his Interest is stimulated.? 

Aside from being motivated, what does the player of a game learn 
from the simulation experience? He is said to learn useful and/or 
desirable attitudes and values vis-a-vis himself, and economic, social. 



6. William S. Nesbitt; "Simulation Games for the Social Studies 

Classroom"; The Foreign Policy Association, New York, N. Y.; 1968, 
p. 34. 



7. For example, see Jerome S. Bruner; "Toward a Theory of Instruction"; 
W. W. Norton and Co., Inc., New York, N. Y. ; I960, p. 95. 

8. Elliot Carlson; "Learning Through Games"; Public Affairs Press; 

1969, pp. 158 (quote), 12G. 

9. John W. Burton; "University of London: Simulation in the Teaching 

of International Rel nti*> C. Londc-.*., L. . v -n, Lngl-.nd; 1965. 
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and/or political systems and subsystems with which he will need to 
interact. These tend to build one on the other. The depth of involve- 
meat of the individual student in a game and his ability to test 
theories about the simulated system in which he operates and about how 
to manipulate it successfully may serve to: 



• • • modify certain dimensions of the personality of the 
individual— his self-esteem, his self-confidcnce and feelings of 
efficacy, which are known to be important variables in the 
political behavior of the adult . . .10 

The principal positive behavioral result is a propensity to participate 
In social life. Although there is a danger that overconfidence will be 
bred in games, most introduce an element of fortune "to replicate the 
real world and teach the student that it is not completely amenable to 
his manipulation. "11 Even when the game world proves susceptible to 
student manipulation, gaming can prove to be a sobering experience 
similar to one undergone recently by a cadet in the POLIDOX game: 



When the game first began everyone was calm because we all knew 
where we stood and had decided that we'd play the negotiation 
game . . . . 

* t 

Once individual desires or goals became hemmed in by other nations* 
objectives negotiations went out the window • • • • 

\ 

The situation was very real. It allowed us to display our 
ineptness at functioning in a rational manner. It displayed 
perfectly our inability to compromise and think maturely when the 
pressure was on ... • 

... I would suggest requiring all cadets to play Polidox. Why? 
Because it scares me to sec how unprepared we are to cope with real 
life situations and perhaps the game can open up a lot more cadet 
minds to our inability- to live in the 21st century as we think we 
are so very capable of : doing. 12. 



10. Philip M. Burgess and James A. Robinson; "Political Science Games 
and the Problem- Solver State," Boococ'.c unu Schmid; p. 247. 

11. Nesbitt, p. 35. 

12. David J. Palenchar; "Comments on POLIDOX"; USAF Academy, by the 
author; 1969, pp. 1 - 2 . 
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The Involvement, role identification, success, and frustration 
experienced in games may have beneficial effects beyond encou: 'iging 
social participation. They may also serve to mitigate pre-adult 
disaffection from today* c policy elites and the restraints and choices 
imposed by the social systems with which those elites must deal. Simi- 
larly, in the research area' such intense involvement of identification 
may serve to generate an unusual number of tentative hypotheses with 
regard to social theory on the part of the players, which can be trans- 
ferred to researchers in a properly designed critique session. 

What of the impact on vhe participant *s attitudes toward social 
systems? Not a great deal has been said in the gaming literature 
about this aspect of attitudinal socialization. What little has been 
reported is mostly negative; Findings in other areas of educational 
research, however, would tend to indicate that games, through the 
intimate involvement that they often foster among as well as rithin 
teams, might have a positive impact analogous to the one described here; 



. . . special types of. curricula may have greater influence (on 
attitudinal socialization}. American students who learned about 
West Africans by reading only historical - , . 1 geographic accounts 
expressed more social distance from the Africans, and a desire to 
maintain such distance, than did a class who read about the daily 
lives of the people, the problems they faced, and the help being 
given them through International aid bodies. ^ 

Such an impact may be very different from that which one would expect 
through social interaction in the real world. Kcnce certain research 
ends may be less well served through this effect than socialization 
objectives. Much is claimed by enthusiasts for simulation games as 
instructional devices along, another dimension. For example: 

• • • (in the past!, when games and play have been accepted as 
appropriate for the classroom, intention has primarily been to 
arouse Interest and to. motivate the student to further study . • • • 
fMany) games £ in use today). • • are intended to tcr.c h, as they 
are, just as a chapter in a textbook or a lecture can teach. ^ 

The content of what is learned does not seem so much to be specific 
facts, or even particular generalizations about international behavior 
(although there is some testimony to this type of learning in the 



13. Richard E. Dawson and Kenneth Prewitt; "Political Socialization"; 

Little, Brown and Company, *•;- chuoeccs; 1969, p. 151. 

14. Boocock and Schild*, p , 14. 
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literature from teachers and students alike). ^ This at once tends to 
call into question the value of historical games like Empire and to 
lessen the criticism of other games concerning their lack of isomorphism 
to reality. What simulation games do offer, at lo.-st in the field of 
education, according to the literature, is an excellent medium for the 
integration of facts and principles about social systems learned else- 
where, and above all a vehicle to aid the student in conceptualizing on 
a systemic level. 16 For example, "students do not simply learn about 
the balance of power; . . • they experience it. 17 if a game is not iso- 
morphic with reality, if it does not, for example, accurately represent 
the behavior that is characteristic of a balance of power system, 
that is the intent of the simulation, all is not lost. Gamers would 
point out that the researcher, or the properly prepared and guided 
student, may learn. as much or more in critiquing the game, comparing it 
to reality, and then engaging anew in a model-building or refining 
process. 1° 

Perhaps more important than the discovery, verification, or in- 
culation of social facts and principles through simulation games is the 
development or discovery of skills or hypotheses regarding decision- 
making, manipulative, and interactive behavior. With regard to training 
uses, this relates to what was said earlier concerning tl - socialization 
of the participants in games through realistically increasing their 
sense of efficacy. That sense largely derives from player-perceived 
acquisition of new skills. Many reporters would agree that such skills 
are actually acquired. For example, in the case of the Carnegie Tech 
management game (admittedly more explicitly designed for training 
decision-making and implementing skills than most games): 

... the participants became more sophisticated about abstract- 
ing* organizing and using information from a complex and diffuse 
environment. Also, they became better at distinguishing between 
valuable and trivial information, and finally, they became more 



15. Clark Abt; "Twentieth Century Teaching Techniques"; The Faculty. 

XXX; August, 1966, p. 2. — — u 

16. Sarane S. Boocock and James S. Coleman; "Games with Simulated 
Environments for Social Studios"; Department of Social Relations, 
Johns Hopkins University, Baltimore, Maryland; n.d., p. 15. 

17. Nesbitt, p. 32. 

18. Western Behavioral Sciences Institute; "An Inventory of Hunches 
About Simulation as Education fools"; W^SI, fa Jolla, California; 
1965, p. 1. 



effective at coordinating information and actions between the 
separate functions of marketing, production and finance *19 

If the above testimony is not too unrepresentative— E. 0. Schild 
vould cay that it is not— —and if r- ; -r^css and ivo'jxnson arc right that 
the coming age will be one of the wvidinioce of the professional decision** 
maker, then the learning of . decision-making and implementing skills may 
be the most Imp ortant educational outcome achieved through simulation 
games. ^0 Similarly, the opportunity to observe the application of 
decision-making skills in different situational contexts may lead to the 
most important and valid research application of simulation games. 



Whatever facts, principles, strategies, or skills may be discovered, 
tested, or learned in games, these occur with - higher probability of 
perception or retention than in the case of similar Items of knowledge 
and insights obtained through more traditional teaching and research 
techniques. According to Andrew M. Scott: 



... the chances are that information acquired while the indivi- 
dual is under stress and is emotionally involved is likely to be 
internalized more fully than information acquired more casually. 



Unless a researcher is a player, however, this benefit is only indirectly 
obtained through the critique session mentioned earlier. 



Previously, we mentioned a few tentative differentiations that can 
be made in the literature concerning the relation of learning and 
research outcomes to participant characteristics. A few observations 
might be made at this point with regard to variations in participant 
types. The needs and the levels of motivation, socialization, knowl- 
edge, and skill of both students and the practitioners differ vastly. 
Beyond certain limits, as yet undefined, some games would thus seem to 
be appropriate for one group but not for another. Simulation game 
enthusiasts would claim, however, that the limits are fairly broad, and 
that one of the truly outstanding and unique features of simulation 
games in education is that they "equalize or compensate for differ- 



19. Carlson, p. 43. 

20. E. 0. Schild, 'The Shaping of Strategies," in Boocock and Schild, 

pp. 143-154; Burgess ixo bins on, pp. 243-249. 

21. "Simulation and National Development"; University of North 

Carolina, Dept, of Politico*. Sci O- 4.1 v» * — p C A ilx 4 1, N. C.s 1965, 

?. 14. 
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eniial student status or background and experience." 2 Each student 
]. the opportunity to order information in the particular way and at 
the particular level it makes active to him. As Ronald C ■» Klictach of 
Instructional Simulations, Inc., puts it: 



. . . information in simulations is not provided in any form, in 
any sequence until the participant in ready to do somethin?!: with 
i r 23 

w v> • 



By contrast, when a teacher lectures or writes a syllabus he is 
saying, ’This is the best way to learn this subject." 



When games are used for social science research, on the other 
hand, some groups would be appropriate for one game or one research ala 
but not another, and the limits may not often be very broad. For 
example, advanced students and practitioners might be desirable to 
replicate real-world social systems, while the uninitiated, with their 
Wchanu^ied" minds, might be preferable to explore hypothetical social 
arrangements . 



And all of this at less cost! Or at least so some enthusiasts 
would have us believe. Time, facilities, money, and personnel are all 
claimed to be required in not .much larger, and in some cases smaller, 
amounts than is the case with ' traditional techniques used for teaching 
and research in the same substance at the same or a lower level of 
effectiveness. 2 ^ But, surely, simulation games cannot be as good as 
all that. 



Disadvantages 

A careful search of the literature will produce a list of dis- 
advantages which is, point for point, a mirror image of the list of 
advantages. To cite a few examples, most accounts of simulation games 
report that the participants were Intensely interested in and motivated 
by the experience, but some teachers who have tried the technique 



22. Carlson, p. 121. 



23. Ronald G. Klietsch; "An Introduction to Learning Games and 
Instructional Simulations instructional Sii-.l'.tions and Co., 
ii«v.p^t, Minnesota; 1969. . 

24. Carlson; "Description of the Program of Instruction for Use with 
the ‘international Rcinti Ji.a. T i , p . - — - »■ , a . d . , p . 2 

and other sources. 




report Chat a number of students experienced only horedon. 2 ^ Despite 
Get t ions in the literature that the game partici; :«t is socialized to 
become an active participant in social processes , one may find con* 
tradictory impressions to the effect that "the danger arises that 
g..raes— most of which mirror political and economic institutions as 
they arc— may encourage quiescent and conformist attitudes." 2 ^ 

Although enthusiasts stress the integration of knowledge and the 
systemic perspective achieved through gaming, other reporters claim 
that the student or researcher either is Inculcated with a grievously 
incorrect perception of the real world system, 2 ^ or that no systemic 
perspective is achieved at alls "students do not discover structural 
relationships in the simulate, they memorize thgm t ^ Some commentators 
would disagree with E, 0. S child's assessment of the efficacy of 
simulations in training participants for political decision-making: 

The competitive aspects of a • • . game • • • do arouse motivatior 
and help sustain effort. But they may also detract from long-term 
learning by teaching students to play conservative strategies 
instead of experimenting with new approaches, to emphasize short- 
term profits within the game context at the expense of building 
and trying to achieve long-term strategic plans, and to let 
anxieties about relative performance and grades interfere with 
efforts to learn. 29 

• t 

| 

The disparity in reports of the supposed advantages and disadvan- 
tages of simulation games cries out for explanation. Our review of jthe 
literature on gaming in the classroom and laboratory suggests three ' 
possible factors , any or all of which might provide that explanation. 
First, reports of educational experience with simulation games are 
generally unencumbered by objective data. (Researchers 9 attuned to the 
scientific method, seem less often prone to be this casual about the 
technique*) The principal substitute in support of claims adva n c e d in 



25. See Bernard C. Cohen; "Political Gaming in the Classroom," 
Journal of Politics . XXIV ; May, 1962; pp. 371-372. 

26. Carlson, p. 173. 

27. Ibid* , p. 176. 

28. Nesbitt, p. 42. 

29. James L. McKenney and William R. Dill; "The Effects of Team As- 

signment and Faculty Bo. c;. Student v ' and Learning," 
in Simulation Games and 7~rv »-->»» : ed. by : . Boccock and 

E. 0. Schild; Sage Publications, Inc., Beverly Kills, California: 
1968; p. 230. 
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favor of simulation games is logical deduction from theories of learn- 
These theories mainl .--in, for example, that :■ ..tivation is a ncces- 
ary prerequisite to learning •uv* chat tangible reward or punishment 
enhances motivation. Those who w:iicvc in the utiiicy of gaming reason 
that the rewards or punishrac;.- '» whi.cl» games provide are more immediate 
n».d tangible thau those prcvA-u-d t -.c student by traditional teaching 
methods, and they then go on to conclude that simulation games produce 
greater motivation than traditional teaching techniques, and hence are 
better learning tools. { 



In defense of thocewho rely upon deduct!' .a argument to support 
their claims, we should point out that Cl*4p I, riCui. Lc^ Co ucccsssiry to 
provide an objective answer are not so easy to construct as one might 
first believe. What is the proper test of acquire knowledge? Every 
teacher has struggled with that question. We are fairly confident of 
our ability to devise tests which measure factual knowledge, but less 
confident of our ability; to test for knowledge of concepts or the as- 
similation of theoretical mo* :1s, the more frequently claimed outcome 
of games. Employing the" usual methods for testing social science 
knowledge thus may bias the results of a closely controlled experiment 
designed to measure and compere the knowledge acquired through gaming 
with that acquired through traditional teaching methods in favor of the 
latter. Is there a fair, test -of conceptual or theoretical knowledge? 

To have the student restate the definition of a concept, he has memo- 
rized may not really test his understanding of that concept in use. 

Yet, it is the latter which the experience of simulation games is 
supposed to contribute to the student's education. 



In research, a related problem arises: can one ever be sure that 

the elements relevent to.' a concept or the variables acting witain a 
system are present? Replication of a historical event or condition 
may be possible in a game as a check but this does not mean that all 
elements or variables acting to produce that event or condition in the 
real-world are present, j 



Some empirical studies have been attempted in educational applica- 
tions, most treating simulation at the secondary school level. For j 
the moat part, these tes'ts have concluded that no significant differ- 
ences exist between the knowledge acquired by the control group sub- 
jected to traditional teaching methods and the knowledge acquired by 
the group exposed to a simulation game Still, one should be cau- 
tious in interpreting these results. Perhaps the “no difference" 
findings were the result, of an inappropriate test of the kind des- 
cribed above. : 



30. See Nesbitt, pp. 41-42 and Carlson, pp. 171-172. 
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If new empirical studies have been accomplished, how do advocates 
of gaming justify their position, other than, in the case of eauca— 
ticr.al uses, by deduction fro;.; learning theory? The usual justifica- 
tion takes the form of a subjective evaluation. In education, teach- 
ers incorporate a game in their course and observe the gatne*s effect 
upon the students. This type of appraisal generally io accomplished 
in conjunction with an end-of-course questionnaire administered to 
students in order to discover their subjective judgement of the gaming 
experience. The teacher then concludes that the "experiment" with 
simulation was a success (or a failure) and cites appropriate "typical" 
commentary from the questionnaire as evidence. Researchers who have 
used games and reported favorably on the results usually have experi- 
mented with the method in conjunction with other techniques. Perhaps 
in so doing they have attempted to guide the course of events in the 
game to correspond with the results derived elsewhere, and have con- 
cluded that games "added significantly," but usually no more than 
heuristically, with their usual research task. This method of evalua- 
ting the utility of simulation games leads us to a second explanation 
for the confused picture presented by the literature on gaming in the 
classroom and the laboratory. 



Reports of the actual use of simulation games tend to fall into 
one of two categories— very favorable reaction or very unfavorable 
reaction. In terms of quantity, most accounts fall on the favorable 
side of the ledger. Bernard C. Cohen has suggested a reason for this. 

He asks if possibly those who direct games and conclude that the ex- 
perience was worthwhile might have approached their evaluation with a 
preconceived bias in favor of simulation. Lacking objective criteria, 
such individuals may see in the simulation only "the evidence which 
confirms their wisdom in conducting the exercise • A favorable pre- 

disposition toward gaming may bias not only reports of results but the 
results themselves. The effect of games in the hands of the enthusiast 
may be impressive, but the average teacher may not be able to produce 
the same kind of results. Similar reasoning might explain the reports 
of unfavorable experiences. If the experimenter begins his evaluation 
skeptical of the value of simulation games, his bias might both adverse- 
ly affect his conduct of the games and color his subjective judgment 
of results. 



If the above chain of reasoning is sound, the subjective nature 
of most evaluations of the utility of games coupled vith the tend- 
i encles to effect learning and research outcomes in the manner of a 

self-confirming hypothesis and then to read the evidence through the 
tinted spectacles of preconceived bias provides the second factor 
which might explain the conflicting reports of classroom simulations. 

f 

r 

I 

. — — — — 

[ 31. Cohen, p. 371. 
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There is still a third explanation. Moot 
who have experimented wiui the simulation tech 
per on.il experience with only one, or at most 
- of games; yet the scop- of f * ir coacl.*. . 



'y application to all " 



oiiiiercnL g*. 

In 



teachers and researchers 

• '.« »c h. vc a,..1 uir»_ct , 

-o or v. a'a i* c. c- } oiiirarent 
on a 4 *, 

• .r.i. i. «>•</»» ver 

fact , wc suspect that this 



ly claim or 
, may have 



uiiicrent learning or research outcomes „ 

would make a better initial assumption than the opposite, that all 
simulation games no matter vhat their structure have the same influence 
upon outcomes. 



• Having criticized others for asserting conclusions about the 
relative worth of gaming on the oasis of inadequate empirical data, we 
shall now proceed to make the same error. Simulation has been done at 
the Academy for over five years. We have not yet used games in any 
systematic research effort,' nor have we made a systematic investigation 
of the teaching value of the games we play. We have only personal, sub* 
jective judgments to offer about the utility of games, judgments of our 
students as well as ourselves. 



Our experience suggests that simulation games suffer from three 
serious weaknesses. First ic the lack of control which the teacher has 
over w.ut is learned during, the gar- or the instructor would have over 
certain kinds of variables* worth investigating. In education, we are 
satisfied tuat the majority of players learn the "right" lessons from 
the game, the lessons we intended them to learn. But now and then we 
discover a student who has learned the 'Vrong" lessons. Traditional 
teaching method* include making certain that students learn the "right" 
lessons by telling them explicitly what the "right" lessons are. While 
simulation games are supposed to be a superior teaching technique in 
that the "right" lessons are discovered by the student himself through a 
process of trial and error in the simulated wr^ld, at times the simulated 
world, like Frankenstein's monster, develops a will of its own, takes 
off in a direction unintended Ly its author, and begins to spew forth all 
sorts of "wrong" lessons. When this occurs the teacher has a difficult 
time "correcting" the learning experience of the student. After all, if 
it is true that living through the experience of a simulated world plants 
a lesson more firmly in the minds of a student thin does reading about 
that experience, then it is- true that "wrong" lessons rvsy be planted 
equally deep during the play of a game. In research, needless to say, 
it is even more difficult to correct the 'Strong" lessons than in teach- 
ing, in that one is less certain what the "right" lessons arc. Overly 
controlxing to ensure the 'bright" wessons may simply be an exercise of 
insuring self- confirming hypo these a. 



The second disadvantage ve have encountered is the 
arranging student or subject • ~ - '• I:s, cl. .*> 
and t*.s physical setting require* for a game. *fo 



problem of . 
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virtues of gaming these are minor problems. They claim that "simula- 
tion„ do not r-.quirc the u * * - facilities or equi;- .cr.t beyond what is 
present in almost every school or what can borrowed or fabricated by 
re Jwrrceful students and ‘teachers."^ For other*., "simulation can be a 
complicated procedure retiring space and equipment. "33 We atand with 
the latter group. 



It is true that if students and teachers are sufficiently motivated 
to try a simulation, the necessary time to conduct play can be found on 
weekends and evenings if schedules will not permit play during regular 
class hours. It is also true that imagination and ingenuity can go a 
long way in adapting existing physical facilities to what is required 
in order to play a particular game. Nevertheless, these matters take 
considerable time to arrange and must be counted as a liability in using 
the simulation technique Furthermore, we should like to stress that 
physical arrangements are:; seldom if ever neutral in their effect upon 
the game. Whatever physical arrangements are chosen introduce a kind 
of artificial geography into the structure of the game which the experi- 
ences of others as well as ourselves have shown bear important 

consequences • 34 

The third disadvantage of simulation games is the cost of gaming 
in terms of the teacher's; or researcher's (and sometimes the student's) 
time. Here again tl;*. re is disagreement. Some who experimented with the 
technique conclude vhat "larger numbers of students -can be taught 
effectively with no increase in staff. "35 We disagree. Our experience 
with games has been that it: it quite expensive in terms of the indivi- 
dual supervisor's time and in terms of the supervisor-participant ratio 
which games require. During the play of the game, the supervisor must 
monitor events, make on-tfre^spot rulings unanticipated in the design of 
the game, and otherwise act as a judge and final authority as to how 
the game rules are to be interpreted and applied. As mentioned 
previously, it takes time to make the necessary physical arrangements. 
Between periods of play the game supervisor is often engaged in perform- 
ing numerous calculations: of results. 



32. Hall T. Sprague; "Using Simulation to Teach International 

Relations"; WBSI, La Jolla, u«dt | p« 114. 

33. Burton, p. 4. 

34. For example, see Cohen, p*>. 377-378. 

35. Burton, p. 4. i 
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Of course some games are more demanding of the teacher* o or 
researcher's time than others. A carefully constructed g~me which has 
been refined and ‘'debugged" by vay of several replications mi nut be 
i led with ease by one person. Cm ’pur era can red-.e the t.'i'.e neces- 
sary to keep books and make computations, but may result in trading one 
type of coat for another. 



Conclusions 



It would be presumptuous to advance conclusive propositions on the 
basis of this working paper. V.c have no firm conclusions to state at 
this time. We have only vague hunches about the v- lue of simulation 
games in teaching and research, and our hunches tell us that something 
of value is there. Final' •in SX*7C IT 3 lull 3 t await the empirical research in 
which we ourselves are engaged which would encourage others to undertake. 



Our present research efforts include the development of a cuestion- 
naire to be distributed ti> those members of the academic community, 
government agencies, and private research organization we can identify 
as having had experience with simulation games in the social sciences. 
This questionnaire will ptovidc survey data which \*ill be used to refine 
a descriptive typology of * simulation games, their applications, their 
circumstances of use, and. their users, jjy means of this questionnaire 
we also intend to survey gathers concerning their subjective and, where 
possible, objective assessment of both the absolute and relative advan- 
tages and disadvantages of the gaming technique. 

V7e seek more than description. Wc plan to use the data garnered 
from the survey effort to relate the descriptive characteristics 
mentioned above to learning and research outcome experienced by the 
respondents, which we will take to be a representative sample of the 
gaming universe. Our ultimate aim is to identify independent and 

dependent variables relating to the use of simulation games, to infer 
causality, and to establish norms for ga:*ie use I>. sed on the inferences 
that we derive. In particular, we hope to be able to point out the 
opportunity costs and benefits of the use of simulation games in areas 
of social science teaching and research already at least adequately 
dealt with by other techniques and to identify absolute costs and 
benefits in areas in which no other adequate tools exist. 

Why do we set this task for ourselves? First, we are subjectively 
convinced of the value of* gaming from our ov.-- c„- r fence hare at the 
Academy. Second, even if.wc were convinced ly -ho arguments of the 
skeptics and the debunkers which, to acme cv. . mry: , we have been, we 
might still feel the present ei.h *t *■ , worthwhile. Ac one disappointed 

experimenter with simulation game.; wrote seven years ago: 
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... An enterprise which requires such a heavy investment of 
time , effort, and resources as L ;I- ; does, ougnt to uavc a 
predi ctably high return. It would be h. r * to ts;^t such a 

point has been reached t ;» r«-s<r:t tine, » though one can go 

a step further ard argue Li'- ♦ *.*• v:j 1 ; t* ’cr • ; h rue/, a p o in u 

unless there is further 






ICw u i,‘ ■ 



v L-b , or. rare properly . 



development of, the technique . (italics added) 

All the votes have not been cast on the question of whether or. not 
simulation is worth it all* We hope to make the ballot box available. 
While there may be only a small chance that simulation games will 
eventually provide the breakthrough they promise, wc are convinced that 
the potential returns make it worthwhile to take that risk. 



36. Cohen; p. 380. 
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